Skip to content

support for Build tree efficient kernel. - #451

Draft
krishnanand-k wants to merge 8 commits into
sgl-project:mainfrom
krishnanand-k:build_tree_eff
Draft

support for Build tree efficient kernel.#451
krishnanand-k wants to merge 8 commits into
sgl-project:mainfrom
krishnanand-k:build_tree_eff

Conversation

@krishnanand-k

@krishnanand-k krishnanand-k commented Aug 27, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Benchmark Results :

provider bs topk steps draft_tokens us nodes_per_sec_M mask_cells_per_sec_M bandwidth_gb_s
sycl 1 1 3 4 7.38 0.54 2.17 0.03
triton 1 1 3 4 8.84 0.45 1.81 0.02
sycl 1 4 3 8 7.70 1.04 8.32 0.06
triton 1 4 3 8 10.76 0.74 5.95 0.04
sycl 1 4 3 16 8.27 1.94 30.96 0.12
triton 1 4 3 16 16.85 0.95 15.19 0.06
sycl 1 8 4 32 9.41 3.40 108.80 0.27
triton 1 8 4 32 46.59 0.69 21.98 0.05
sycl 1 8 5 64 11.02 5.81 371.55 0.63
triton 1 8 5 64 147.94 0.43 27.69 0.05
sycl 8 1 3 4 7.80 4.10 16.41 0.21
triton 8 1 3 4 9.41 3.40 13.60 0.17
sycl 8 4 3 8 8.11 7.89 63.12 0.45
triton 8 4 3 8 11.75 5.45 43.57 0.31
sycl 8 4 3 16 8.50 15.06 240.88 0.91
triton 8 4 3 16 18.62 6.88 110.01 0.42
sycl 8 8 4 32 9.20 27.81 890.05 2.18
triton 8 8 4 32 50.54 5.06 162.08 0.40
sycl 8 8 5 64 10.56 48.50 3104.21 5.24
triton 8 8 5 64 165.57 3.09 197.91 0.33
sycl 32 1 3 4 7.80 16.41 65.64 0.82
triton 32 1 3 4 9.52 13.45 53.80 0.67
sycl 32 4 3 8 8.06 31.76 254.09 1.81
triton 32 4 3 8 11.93 21.45 171.61 1.22
sycl 32 4 3 16 8.58 59.67 954.78 3.61
triton 32 4 3 16 19.14 26.76 428.09 1.62
sycl 32 8 4 32 9.15 111.89 3580.42 8.76
triton 32 8 4 32 51.40 19.92 637.48 1.56
sycl 32 8 5 64 11.08 184.90 11833.88 19.99
triton 32 8 5 64 173.47 11.81 755.58 1.28
sycl 64 1 3 4 7.96 32.18 128.71 1.61
triton 64 1 3 4 9.78 26.19 104.75 1.31
sycl 64 4 3 8 7.96 64.35 514.83 3.67
triton 64 4 3 8 11.86 43.18 345.48 2.46
sycl 64 4 3 16 8.06 127.05 2032.75 7.69
triton 64 4 3 16 19.50 52.51 840.21 3.18
sycl 64 8 4 32 9.46 216.40 6924.77 16.93
triton 64 8 4 32 51.90 39.46 1262.83 3.09
sycl 64 8 5 64 11.02 371.55 23779.39 40.17
triton 64 8 5 64 172.59 23.73 1518.90 2.57
sycl 128 1 3 4 8.06 63.52 254.09 3.18
triton 128 1 3 4 9.65 53.08 212.32 2.65
sycl 128 4 3 8 8.53 120.08 960.60 6.84
triton 128 4 3 8 12.43 82.39 659.16 4.70
sycl 128 4 3 16 8.84 231.67 3706.79 14.02
triton 128 4 3 16 19.71 103.92 1662.68 6.29
sycl 128 8 4 32 10.45 391.89 12540.38 30.67
triton 128 8 4 32 53.98 75.89 2428.34 5.94
sycl 128 8 5 64 11.18 732.74 46895.17 79.23
triton 128 8 5 64 184.86 44.31 2836.14 4.79
sycl 256 1 3 4 11.08 92.45 369.81 4.62
triton 256 1 3 4 9.93 103.10 412.40 5.16
sycl 256 4 3 8 11.65 175.82 1406.59 10.02
triton 256 4 3 8 12.64 162.08 1296.61 9.24
sycl 256 4 3 16 12.58 325.49 5207.88 19.69
triton 256 4 3 16 20.23 202.49 3239.87 12.25
sycl 256 8 4 32 15.44 530.43 16973.84 41.51
triton 256 8 4 32 54.60 150.04 4801.17 11.74
sycl 256 8 5 64 19.34 846.98 54206.78 91.58
triton 256 8 5 64 189.90 86.28 5521.61 9.33

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot
Copilot will automatically review once the pull request is marked ready for review

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@krishnanand-k